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Field of the Invention 



The invention relates generally to communication 
systems, and more particularly to a method for 
transporting multimedia information in a communication 
10 system. 



use of one or more media services, such as voice, 
video, and data, in a single communication session. 
Recently, a number of standards, such as H.323, have 
been defined that address the requirements for 

20 multimedia communications in a wireline packet switched 
network. Recently GPRS, a packet switched network 
overlaid on the existing GSM (Global System for Mobile 
Communications) network, has been standardized by the 
European Telecommunications Standards Institute (ETSI) . 

25 Given the above trends in the wireline and 

wireless communications, there is an increased desire 
to support multimedia applications in wireless cellular 
networks. Further, in the interest of fixed-mobile 
convergence, there is an emphasis on employing, or 

30 reusing as much as possible, existing wireline 
protocols for wireless networking applications. 

There are various problems associated that 
necessitate the use of middle-ware for multimedia 
applications in wireless applications. As used herein, 
35 the term middleware refers to software or firmware in a 



Background of the Invention 
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Multimedia communications involves simultaneous 
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layered architecture that provides tools to application 
software to better utilize the lower layers. In 
wireline applications, traffic from the various 
component media streams are treated the same. However, 
5 in wireless networks, different media streams must be 
treated differently for optimum performance . For 
instance, the channel coding used is usually dependent 
on the media being transported. Further, different 
Quality of Service (QoS) objectives may be suited for 
10 different traffic streams. For example, voice codecs 
(coder/decoder) may be more resilient to errors than 
video codecs. 

Wireless environments are typically poorer, when 
compared to wireline transmission channels, and further 
15 difficulties arise due to channel error characteristics 
changing rapidly. Transport protocols, such as the 
Transmission Control Protocol (TCP) , in wireline 
networks are tailored for the relatively error- free 
wireline environment and are unlikely to perform as 
20 desired in wireless environments. 

As an example of current multimedia applications, 
FIG. 1 depicts a multimedia application 100 in 
accordance with the prior art. Multimedia application 
100 includes a voice coder (vocoder) 105 and a video 
25 coder 106. A voice signal 103 is input into vocoder 
105, which performs voice coding functionality and 
passes the coded voice signal to multiplexor (Mux) 107. 
A video signal 104 is input into video coder 106, which 
performs video coding on the signal and passed the 
30 coded signal to mux 107. A data signal 108 is input 
into mux 107. Multiplexor 107 performs multiplexing 
operations on the signals, as is well-known in the art, 
and sends the multiplexed signal to channel coder 109. 
Channel coder 109 codes the multiplexed signal and 
35 sends the signal to pipe 110. It should be realized 
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that the coded signal sent to pipe 110 is a combined 
signal that includes a voice portion, a video portion, 
and a data portion. 

When receiving a signal, multimedia application 
5 100 receives a coded signal at pipe 110. Pipe 110 

passes the signal to channel decoder 111, which decodes 
the signal and sends the signal to demultiplexer 113 . 
Demux 113 demultiplexes the signal, and sends component 
portions of the signal to an appropriate decoder. A 
10 voice component is sent to voice decoder 115, which 

performs decoding operations on the signal and outputs 
a decoded voice signal 119. Demux 113 sends the video 
portion of the signal to video decoder 117, which 
decodes the signal and outputs a video signal 121. 
15 Demux 113 outputs a data signal 123. 

The overhead associated with wireline protocols is 
significant, especially when used as-is over currently 
defined wireless packet networking protocol stacks. 
This renders their use over scarce wireless 
20 transmission capacity a liability. 

In short, the multimedia applications of today are 
designed such that the lower layer protocols, Layerl, 
Layer 2, and Layer 3, are not aware of the contents of 
the data they transfer. As used herein. Layer 2 (L2) 
25 provides functionality for error detection and 

correction including any retransmission of packets. 
Given the unpredictable nature of wireless channels, it 
is essential that the lower layers be tailored to meet 
the specific demands of the various traffic types. 
30 Thus, a need exists for a method for sending and 

receiving multimedia information in a communication 
system. 
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Brief Description of the Drawings 

FIG. 1 depicts an architectural representation 
of a multimedia application in accordance with the 
5 prior art; 

FIG. 2 depicts a communication system in 
accordance with the preferred embodiment of the 
present invention; and 

FIG. 3 depicts an architectural representation 
10 of a multimedia application in accordance with the 
preferred embodiment of the present invention. 



Detailed Description of a Preferred Embodiment 

15 

The present invention provides a method for 
transporting, via transmitting and receiving, 
multimedia information in a communication system. The 
method includes the steps of receiving, preferably over 
20 the air, a plurality of streams that together form a 

multimedia session. The plurality of streams are then 
decoded, based upon the content of each individual 
stream, to form a plurality of decoded streams. Layer_ 
2 funct^^r^^'^ i <-y__j,^_then_ performed uporL-each„of_:the 

25 plurality of decoded streams^ 

^ The present invention can be better understood 

with reference to FIGs. 2 and 3. Referring now to FIG. 
2, a Global System for Mobile communications (GSM) 
communication system 2 00 in accordance with the 
30 preferred embodiment of the present invention is 

depicted. Communication system 2 00 is preferably a GSM 
system, but could alternately be . any digital 
communication system that processes multimedia streams, 
such as PDC, Advanced Mobile Phone Service (AMPS) , 
35 United States Time Division Multiple Access (US-TDMA) , 



Code Division Multiple Access (CDMA) , or any other 
suitable communication system. Referring to FIG. 2, 
acronyms are used for convenience. The following is a 
list of the acronyms used in FIG. 2: 

BTS Base Transceiver Station 
BSC Base Station Controller 

GSM Global System for Mobile communications 
HLR Home Location Register 
ISDN Integrated Services Digital Network 
MS Mobile Station 

MSC Mobile Switching Center 
OMCR Operations and Maintenance Center - 
Radio 

OMCS Operations and Maintenance Center - 
Switch 

PSTN Public Switched Telephone Network 
VLR Visitor Location Register 
XCDR Transcoder 

A first base transceiver station (BTS) 201 is 
located in a first coverage area 2 04 and 
communicates with a mobile station 205. Mobile 
station 2 05 can be a mobile unit, a remote unit, a 
fixed wireless terminal, or any other unit capable 
of sending or receiving RF communications to or from 
first BTS 201, and more particularly, that is able 
to send multimedia information. As used herein, 
multimedia information refers to information that 
includes at least two of different types of 
information, such as voice, video, or data. 
Communication is via a first digital radio channel 
212 that contains data information compatible with a 
GSM communication system. 
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Mobile station 206 communicates with second BTS 
2 02 that is located in second coverage area 2 07. 
Communication is via a second digital radio channel 
213 that contains data information compatible with a 
5 GSM communication system. Base transceiver stations 
201 and 202 can include multiple channels. 

Also included in FIG. 2 is base transceiver 
station 202 located within coverage area 207. BTSs 
2 01 and 2 02 are each coupled to a base station 
10 controller (BSC) 214 which includes an XCDR 210. 

XCDR 210 routes the speech information to and from 
the base transceiver stations 201 and 202. The 
speech information is routed to an MSC 215 which 
provides switching functions for access to PSTN 22 0 
15 or ISDN 222. Home Location Registry (HLR) 216 and 

Visitor Location Registry (VLR) 217 provide location 
and billing services for the entire system as is 
well known in the art,, while OMCS 224 and OMCR 212 
provide diagnostics and maintenance services for the 
20 entire system, as is also well known in the art. 

Mobile stations 205 and 206 each preferably 
include a receiver, a transmitter, a processor, and 
memory. The receiver receives information from BTSs 
201 and 202, respectively, via first channel 212 and 
25 second channel 213, respectively. The transmitters 
transmit information to first base station 201 and 
second base station 202, respectively. The 
processors update variables pertaining to mobile 
stations 205 and 206 based at least in part upon the 
30 information received from BTSs 201 and 202. The 

memory stores information related to mobile stations 
205 and 206. 

FIG. 3 depicts an architectural representation 
35 of a multimedia application 300 in accordance with 
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the preferred embodiment of the present invention. 
Multimedia application 3 00 preferably runs in a 
mobile station and a base station, but can 
alternately run in a BSS, a BSC, or any other 
network element that is capable of sending and 
receiving multimedia information. Multimedia 
application 300 includes a codec 301, middleware 
303, and output ports 304. 

Codec 301 preferably includes matched pairs of 
coders and decoders. In the preferred embodiment 
as depicted in FIG. 3, codec 301 includes a voice 
coder {vocoder) 315, a voice channel coder 335, a 
voice channel decoder 365, and a voice decoder 385. 
Codec 301 also preferably includes a video coder 
317, a video channel coder 3 37, a video channel 
decoder 3 67, and a video decoder 3 87. In the 
preferred embodiment as depicted in FIG. 3, codec 
301 also includes a data channel coder 339 and a 
data channel decoder 369. ^ 

Middleware 3 03 includes signaling functionality 
between each coder and channel coder. Middleware 
3 03 includes, in the preferred embodiment, L2 
functionality 325, L2 functionality 327, L2 
functionality 329, L2 functionality 375, L2 
functionality 377, and L2 functionality 379. L2 
325, L2 327, and L2 329 replace the functionality 
of the multiplexor in prior art systems. 

in prior art systems, the output from a 
vocoder, a video coder, and any data is, sent to a 
multiplexor, which combines the data and sends the 
multiplexed data to a channel coder. In the 
present invention, voice signal 305 is sent to 
vocoder 315 and video signal 3 07 is sent to video 
coder 317, as in the prior art. Vocoder 315 codes 
35 the voice, as is well-known in the art, and video 
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coder 317 codes the video signal, as is well-known 
in the art. Rather than send the coded signals to 
a multiplexor, as in the prior art, the present 
invention sends the coded signals, along with any 
5 other data signal, to middleware 303. Middleware 
3 03 keeps the component media streams separated 
during transport. In this manner, optimal header 
compression occurs for each stream, and channel 
coding is performed on the stream specific to the 
10 source of the stream. 

Signals 3 05, 3 07, and 3 09 can be originated 
from a computer connected to a mobile station that 
includes multimedia application 300. These signals 
may be in their component types when leaving the 
15 computer, or may be multiplexed by the computer. 
In this situation, the multiplexed signal first 
passes through a demultiplexer that splits the 
signal into its component multimedia parts. 

L2 functionality 325 transports the received 
20 coded voice stream to first voice channel coder 

335. L2 functionality 327 transports the received 
coded video stream to a first video channel coder 
337. L2 functionality 329 sends any received data 
stream to first data channel coder 339. In this 
25 manner, each different multimedia stream is 
preferably sent to a different coder. This 
improves over the prior art, which combines all 
inputs and send them to a single channel coder. By 
keeping the multimedia streams separated, optimal 
30 coding can be performed on each different type of 
multimedia stream. 

Coders 335, 337, and 33 9 each perform channel 
coding on the input stream, as is known in the art. 
The output of each of these channel coders is then 
35 sent to output ports 3 04. Output ports 3 04 include 
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pipes 345,, 347, 349, 355, 357, and 359. Each pipe 
is preferably connected to a transceiver that 
facilitates over the air communication between 
elements in a wireless communication system. 
5 As an example of the preferred method of 

operation of the present invention, a multimedia 
stream, comprised of voice stream 305, video stream 
3 07, and data stream 3 09, originates at multimedia 
application 300. Voice stream 305 is sent to 
10 vocoder 315, which performs appropriate voice 
coding and sends the coded voice signal to L2 
functionality 325 located within middleware 303. 
Video stream 307 is sent to video coder 317, which 
performs appropriate coding thereon. The coded 
15 video stream is the sent to L2 functionality 327 

within middleware 303. Data stream 309 is sent to 
L2 functionality 329 within middleware 303. 

L2 functionality 325 sends the coded voice 
signal to voice channel coder 335. Voice channel 
20 coder 3 35 performs appropriate voice channel coding 
on the coded voice signal, and sends the signal to 
its intended destination via pipe 345. L2 
functionality 327 sends the coded video signal to 
video channel coder 337. Video channel coder 339 
25 performs appropriate video channel coding, and 
sends the channel coded signal to pipe 3 47 for 
routing to its intended destination. L2 
functionality 329 send the data signal to data 
channel coder 33 9, which performed appropriate data 
30 channel coding thereon. The channel coded data 

signal is then sent to its intended destination via 
pipe 349, preferably over the air. 

In the preferred embodiment of the present 
invention, the intended destination of the signals 
35 is represented by an IP address. Each signal is 
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kept separated by its type, such as voice, video, 
or data, and sent to the destination using an IP 
address. In this manner, the signals can be routed 
in the most efficient manner. For example, data 
5 signals, which are typically not extremely time- 
dependent, can be resent if an error is detected in 
the signal. Voice and video signals, which are 
very time -dependent, are usually not resent if an 
error is detected. The faulty voice or video 
10 packet is typically discarded. Using the present 
invention, better communications are realized by 
sending the packets separately, so that such 
adjustments, such as whether to resend messages or 
not, can be performed only on packets that benefit 
15 from being resent. 

In a similar manner to the sending of streams, 
a plurality of streams are received by multimedia 
application 300. Tj^e^lAorality of stre ams toget her 
form a multimedia session. In the preferred 
20 embodiment, the plurality of streams are received 
over the air in a wireless communication system. 

As an example of the preferred embodiment of 
the present invention, pipe 3 55 receives a voice 
signal from another multimedia application. Pipe 
25 3 55 sends the signal to voice channel decoder 3 65 
within middleware 303. Channel decoder 365 
performs appropriate voice channel decoding on the 
stream, and sends the channel decoded stream to L2 
functionality 375 within middleware 303. L2 
30 functionality 37 5 chooses which packets to discard 
and how to fill any holes due to lost or discarded 
packets. L2 functionality 375 also sends the 
signal to voice decoder 385. Voice decoder 385 
decodes the signal, and sends the decoded voice 
35 signal 395 to its ultimate destination, typically a 
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speaker which amplifies the signal for detection by 
a user of a communication unit. 

m a similar manner, pipe 3 57 receives a video 
signal from another multimedia application. .This 
5 signalm ay o ^jnayjio ^^e asso ciat ed with the vo ice 
signal received by pipe 355. The video signal is 
^i^^d to vide'o'chamierdecoder 3 67, which perform 
appropriate video channel decoding on the stream. 
The decoded video stream is then sent to L2 
10 functionality 377 within middleware 303. L2 

functionality 377 sends the signal to video decoder 
387, which decodes the video signal and sends the 
decoded video signal 3 97 to its ultimate 
destination, typically a display device for 
15 converted video signal 397 to an image for 

detection by a user of a communication unit. 

In like fashion, a data signal is received by 
pipe 359, which sends the signal to data channel 
decoder 369. Decoder 369 decodes the signal and 
20 sends the decoded data signal to L2 functionality 
39, which outputs data signal 3 99. 

The present invention therefore provides a method 
for transporting multimedia information in a 

25 communication system. The present invention allows 

multimedia applications to be transported efficiently 
over wireless networks by splitting multimedia streams 
into component parts for transport within a 
communication system. The present invention allows the 

30 use of existing and forthcoming communication systems 
that are designed to support single media streams in 
wireless networks. Further, the present invention 
allows existing wireline multimedia standards to be 
used end-to-end. 
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The present invention provides middle-ware that 
provides the lower layer {Ll, L2 , and L3 ) information 
about the nature of the contents of the data being 
transported. This allows the communication system to 
5 provide service that is tailored for each data type. 

The middle-ware of the present invention allows the use 
of wireline applications on an end-to-end basis without 
the liabilities of the prior art. 

The communication system of the present invention 
10 decides when to utilize the present invention to enter 
multimedia mode. As used herein, multimedia mode 
refers to a mode of operation wherein multimedia 
signals are split into at least two different types, 
such as voice, video, or data. This decision can be 
15 made based upon what portion of the communication 
sessions contain multimedia information, the 
capabilities of the network and mobile stations to 
utilize the present invention, or other decisions that 
would allow for optimization of the sessions. Upon 
20 deciding to enter multimedia mode, the other network 
components, such as the mobile station, the base 
station, and any computers connected to the mobile 
station, are alerted that multimedia mode has been 
entered. The decision to enter multimedia mode can be 
25 made by the mobile station, a computer connected to the 
mobile station, or by the network at the base station 
or a controller connected to the base station. Each of 
these elements would then alert the other elements to 
enter multimedia mode to begin utilizing the present 
30 invention. The other elements then begin processing 
multimedia streams . 

While this invention has been described in 
terms of certain examples thereof, it is not 
35 intended that it be limited to the above 
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description, but rather only to the extent set forth 
in the claims that follow. 
We claim: 
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